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Abstract 

Donoho and Stark have shown that a precise deterministic recovery of missing infor¬ 
mation contained in a time interval shorter than the time-frequency uncertainty limit is 
possible. We analyze this signal recovery mechanism from a physics point of view and 
show that the well-known Shannon-Nyquist sampling theorem, which is fundamental in 
signal processing, also uses essentially the same mechanism. The uncertainty relation in 
the context of information theory, which is based on Fourier analysis, provides a criterion 
to distinguish Shannon-Nyquist sampling from compressed sensing. A new signal recovery 
formula, which is analogous to Donoho-Stark formula, is given using the idea of Shannon- 
Nyquist sampling; in this formulation, the smearing of information below the uncertainty 
limit as well as the recovery of information with specified bandwidth take place. We also 
discuss the recovery of states from the domain below the uncertainty limit of coordinate 
and momentum in quantum mechanics and show that in principle the state recovery works 
by assuming ideal measurement procedures. The recovery of the lost information in the 
sub-uncertainty domain means that the loss of information in such a small domain is not 
fatal, which is in accord with our common understanding of the uncertainty principle, 
although its precise recovery is something we are not used to in quantum mechanics. The 
uncertainty principle provides a universal sampling criterion covering both the classical 
Shannon-Nyquist sampling theorem and the quantum mechanical measurement. 

PACS numbers: 
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I. INTRODUCTION 
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Donoho and Stark [l| have shown that a precise deterministic recovery of missing 
information contained in a time interval with a size T shorter than allowed by the 
time-frequency uncertainty principle T > 1/W 2-4] is possible. Here W stands 
for the bandwidth and this specific form of uncertainty relation, which is used in 
information theory, generally arises in the context of the conditional measurement 


in quantum mechanics jfj. This idea of deterministic signal recovery was originally 
discussed at the early stage of the developments of compressed sensing. However, as 
is explained below, this idea is not included in the compressed sensing as presently 
understood, namely, the recovery of a signal from highly incomplete measurements 
by utilizing side information such as sparsity Ml 

The idea of the uncertainty principle in quantum mechanics is well-known, but 
the recovery of information from the domain below the uncertainty limit is something 
new to physicists. The purpose of the present paper is to analyze this signal recovery 
mechanism from a physics point of view and show that the well-known Shannon- 
Nyquist sampling theorem {i], Q] , which is fundamental in signal processing, also 
uses essentially the same mechanism, namely, the recovery of information from the 
domain below the uncertainty limit; this connection of Shannon-Nyquist sampling 
with the uncertainty principle has not been recognized before. 

To our knowledge, the present paper is the first to clarify the connection of 
Donoho-Stark mechanism with Shannon-Nyquist sampling, and the scheme of 
Donoho and Stark is excluded from the compressed sensing since Shannon-Nyquist 
sampling is used as a criterion of conventional sensing. A new signal recovery 
formula which is similar to Donoho-Stark formula using the idea of Shannon- 
Nyquist sampling is illustrated in eq.(28) below; in this formulation, the smearing of 
information below the uncertainty limit as well as the recovery of information with 
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specified bandwidth take place. We also discuss the recovery of information from 
the domain below the uncertainty limit of coordinate and momentum in quantum 
mechanics and show that in principle the state recovery works by assuming ideal 
measurement procedures. The uncertainty principle provides a universal sampling 
criterion characterizing the classical Shannon-Nyquist sampling theorem and the 
quantum mechanical measurement. 

We start with a brief summary of the basic machinery used in the analysis of 
Donoho and Stark [lj. We use a Dirac notation which is directly extended to the 
case of quantum mechanics. (The use of Dirac notation in classical information 
theory should not cause confusion. Besides, the Dirac 5-function is commonly used 
in information theory such as in the discussion of Shannon-Nyquist sampling.) For 
the same reason we consider only the L 2 norm in this paper, although the Li norm 
is more important in compressed sensing. We define the projection operators 

rwo+^W rto+^T 

P w = dw\w)(w |, P T = dt\t)(t\, (1) 

Jw 0 -\W JtQ-\T 

using the relations 

(t\t') = 5(t — t') : (w\w') = S(w — w'), ( t\w ) = exp[— 2Triwt]. (2) 

The projection operator P\y is characterized by the frequency domain [W] = [wo — 
w 0 + \W] and its size or bandwidth \W\ — W >0. Similarly, the projection 
operator P T is characterized by the time domain [ T} = [i 0 — |T, t 0 + |T] and its size 
or time interval \T\ = T > 0. We often use the notation P w = dw\w)(w\ and 
Pt = Jj T j dt\t){t\. We have for a signal represented by |^} 

P w ^(t) = (t\P w \^) = I dwe~ 2mwt ^(w ), 

J[W) 

P T ^(t) = (t\P T \ip) = I dt'5(t-t')jp(t') : (3) 

J[T] 
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by noting ip(w) = (w\^) and ip(t) = ( t\ip). The notations ip(t) and ip(w) are more 
common ones in classical information theory. For simplicity, we consider only the 
intervals [W] and [T], The relation (3) shows that 

Pwi/>(t)= f dwe-^iiw) = e ~ 2niW0t [ dwe~ 2niwt i{w + w 0 ), 

J[W] J[W] 0 

with [PF]o = [—|VF, +^W]; this formula with a known factor e~ 2mwot is important 
when we later discuss the relation of Donoho-Stark mechanism to Shannon-Nyquist 
sampling which is generally defined in terms of [W] 0 . When we compare the un¬ 
certainty relation with Shannon-Nyquist sampling, we simply set tc 0 = 0 in the 
following. 

We can confirm P ^ = P w and P% = Pt, and we have 

{iP\PwPtPw\iP) _ {'fp\Pw(PwPrPw)Pw\ V’) 

{MPw\^) ~ &\PwPwW 

< | \P\yPrPw 11 TW 7 (4) 


by noting the relation 

I l-Pw-Prl | 2 = ||iV-PT-fW|| T Tt(PwPtPw) = H T (5) 

since P W P T P W is positive semidehnite hcrmitian and thus \\P\vPtPw\\ agrees with 
its largest eigenvalue while Tr (PwPtPw) counts all its positive eigenvalues. We 
also used Tr [PwPtPw) = J[w]^ w J[t] dt(w\t)(t\w) = ll'T. The relations (4) and 
(5), and the relations where P\y and Pt are interchanged, correspond to the upper 
bound to the conditional measurement in the case of quantum mechanics [5]; the 
conditional measurement is defined to measure Pw first and then measure Pt for 
the resulting state in the case of (4). The use of the modified state for the second 
measurement, which is related to reduction, is specific to the quantum conditional 
probability and it is different (particularly in the case of non-commuting operators) 
from the classical conditional probability given by the Bayes rule. The relation (4) 
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as an upper bound to the conditional measurement can provide a constraint on the 
actions of Pw and Pt only for TW < 1 since the left-hand side of the relation is 
bounded by unity; for example, 0 < (^PwPtPwW )/("01 < 1, namely, by 

the norm of the projection operator Pt as is confirmed using the definitions in (3). 
To substantiate the above manipulation in (4), we here give a direct proof of (4): 

(^PwPtPwW) _ /[T] dt I[w] dw (e~ 2 ^VM) I [w] dw' 

(i>\Pw\i>) f [w] dw\^(w)\ 2 

< I[T] dt I[W] dw f[w] dw'\[\^{w)\ 2 + |^K)| 2 ] 

I [W ]dw IV’HI 2 

= TW. (6) 

This proof shows that the relation (4) is valid for any values of TW as long as 
J, w , dw\ , il>{w)\ 2 ^ 0, and similarly Jj T j dt\i/j(t)\ 2 ^ 0. There is no lower bound to TW 
except for TW > 0 unless one adds some extra conditions. 

Usually we do not impose the norm such as L 2 on the time dependence in quantum 
mechanics. In the context of signal recovery, we understand that the probability 
smaller than unity in (6) for the case WT < 1 specifies a ratio of the size of the 
signal covered by the projection operator Pt relative to the entire normalized signal 
-fW|V’)/ll-fW|V’)ll measured by the L 2 norm. From the present point of view, the 
uncertainty principle of Donoho and Stark [l[, 

WT > 1 (7) 

is based on an additional assumption of unit probability (or ” e-concentrated” con¬ 
dition [lj) which is expressed by, for example, 

(il>\P w P T P w \1>)/(il>\P w W) = 1. (8) 

This relation (complete measurement) means that ||PtTW|' 0)II = ||-FV|V’)|| together 
with P\yPw IV’) = PwW)- The uncertainty principle by Donoho and Stark is thus 
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a necessary condition for the satisfactory description of a given signal \i/>) by Pw 
and Pt, or a condition so that the measurements of Pw and Pt are consistently 
performed for the signal \i/). The quantum mechanical uncertainty relation for p 
and x in the manner of Landau and Poliak [ll] is also based on a similar condition 
and assumes a similar form as is explained later. 

To be more explicit, for the signal with bandwidth W, we understand the present 
uncertainty relation (7) as showing that the shortest possible time interval [T], which 
can completely confine the signal, should satisfy \T\ > 1/W when we use L 2 norm. 
Similarly, any signal which is completely confined within a time interval [ T] has a 
bandwidth W with W > 1/|T|. 

From the point of view of signal recovery in general, the operation of the ban- 
dlimiting procedure of the observed signal is important. We have 


P w ^(t) = dt' dwe-^^'^it') 
J J[W] 

= I dt'G(t - t'- W)i/j(t') 


(9) 


with 


G(t - t’- W)= dwe - 2jr ™h-0 


'm 


( 10 ) 


which cannot average out to zero for \t — t'\ < 1/|W|. This shows that the time 
dependence of the given signal -0(t) is smeared to the order of At ~ 1/W, which is 
another (and more common) implication of the uncertainty principle. To recover the 
original bandlimited signal, one needs to perform the bandlimiting operation on the 
measured quantity in one way or another, which will close the missing time interval 
smaller than T < 1/W. For example, in the Nyquist ( 9 ] and Shannon [Q sampling, 
one generally measures the bandlimited signal of a fixed [W] with \W\ = W by 
dividing the total time interval into sub-intervals [T'] which satisfy \T'\ < 1/W. 
See eq.(22) below. Since this condition \T'\ < 1/W is an inequality, there is some 
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freedom in the choice of \T'\ and, in practice, one may introduce the frequencies 
larger than the original bandwidth W, W' = 1/|T'| > W, in the measured data 
(i.e., oversampling) depending on the choice of \T'\ which satisfies \T'\ < 1 jW. This 
oversampling corresponds to the violation of the uncertainty relation (7). From a 
point of view of frequency representation, we need the frequency band not smaller 
than W to describe the information contained in the frequency bandwidth W. After 
an elimination of frequency components outside [W] (by a lowpass filter), the original 
bandlimited signal is reproduced in Shannon-Nyquist sampling. 

II. RECOVERING MISSING INFORMATION 

We next recapitulate the basic mechanism to recover the missing information by 
following the presentation of Donoho and Stark in [if: A signal s(t) = (t\s) G L 2 
defined in a sufficiently large interval [T°] is transmitted to a receiver who knows 
that s(t) is bandlimited, meaning that s[t) was synthesized using only frequencies 
in an interval [W] . Equivalently, 

sw(t) = P W s{t) = s(t), (11) 

where Pw is the bandlimiting operator defined by the above projection operator. 
Now suppose the receiver is unable to observe all of sw{t)] a certain sub-interval 
[T] of t- values is unobserved. Moreover, the observed signal is contaminated by 
observational noise n(t) = (t\n) G L 2 . Thus the received signal r(t) = (t|r) satisfies 

|siy(t)+n(t) t G [T c ] 

r (0 = < (12) 

[o te[T ], 

where [ T c ) = [T°] — [T] is the complement of the interval [T], and we have assumed 
(without loss of generality) that n(t) =0 on [T], Equivalently, 


r{t) = (1 - P T )s w (t) + n(t) 


( 13 ) 


where 1 is the identity operator (1 f)(t) = fit) which is given by P ?o in our setting 
of the problem. The receiver’s aim is to reconstruct the transmitted signal Sw(t) 
from the noisy received signal r(t). Although it may seem that information about 
s\y{t) for t e [ T] is completely unavailable, the uncertainty principle says recovery 
is possible provided |T||W| < 1 [lj]. 

The basic idea is to re-write the equation (13) using Pw^wit) = %(i) as 

r(t) = (1 - P T Pw)s w (t ) + n(t) (14) 

and note that the solution of this equation is unique in the absence of the noise or 
for a given fixed noise. Assume that two solutions si(i) and S 2 (t) satisfy the above 
equation, then we have 


(1 - P T P w )(s 1 (t) - s 2 (t )) = 0 (15) 

which implies ||si(t)-s 2 (t)|| = \\P T Pw{siit) - s 2 (t))\\ < ||P T P H /||||(si(£)-s 2 (£))|| < 
||(si(t) — s 2 (£))||, but this is a contradiction if ||si(i) — s 2 (t)|| ^ 0. Here we used 
the relation (5), ||PtPw|| A VTW < 1. By noting the fact that the operator 
1/(1 — PtPw ) is we ll defined for |PrPw| | < 1, we have the unique solution 


%w 


1 

1 — PtPw 


r(t) 


r(t) + ^(PrPwMt) 

k =1 


(16) 


in the absence of the noise n(t) = 0. The noise is important when one analyzes the 


stability of the solution [1], This (16) is a remarkable formula to recover the original 
signal precisely from the observed signal r{t) in the interval [ T c ) = [T°] — [T] and 
the remaining signal in the interval [T provided by the second term. This is the 
basic mechanism of Donoho and Stark 1], 
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III. MEASUREMENT AND DISTURBANCE 


The bandlimited property of the right-hand side is not manifest in the formula 
(16). One can explicitly show that sharp \T\ modifies the bandlimit of r(t). By 
noting r(t ) = (1 — P T )s\y(t) in (13) in the absence of the noise n(t ) = 0, one can 
establish 


( r\P W c \ r ) — {s w \P t Pw c Pt\sw) ^ 0, (17) 

for WT < 1 with P W c = 1 — P w using P\v c \ s w) — 0, since 

(sw|-Pr(l — Pw)Pt\sw) /( sw\Pt\sw) > 1 — WT > 0 (18) 


using the relation (4) with Pt and Pw interchanged. It is remarkable that the 
bandlimit of the observed signal r(t) is modified by the presence of the unobserved 
short interval, but this is an inevitable consequence of the specification of the missing 
time interval with WT < 1. For WT > 1 we cannot make a definite statement on 
the bandlimit of r(t). 

The bandlimited property of the signal Sw(t ) is intrinsic and the interval [T] is an 
external accidental parameter, and in fact Sw(t) is independent of [T] if the signal 
recovery (16) is perfect. One may thus apply the bandlimiting operator to both 
sides of (16) to obtain by noting P w sw(t ) = Sw(t), 


s W (t) = P w r(t ) + ^( P w P T ) k P w r(t) 

1 


fc=i 

-P w r(t) 


(19) 


1 — PwPt 

which shows that the bandlimited signal Sw(t ) is recovered from the quantity Pv^r(t), 
which is constructed by bandlimiting the measured r{t) that is originally defined in 
the domain [T c ] = [T°] — [T], This formula (19) incorporates both of the post¬ 
measurement smearing of the missing time interval by bandlimiting in addition to 
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the deterministic recovery by an inversion of the well-defined operator, and it is 
equally valid as (16). Note that 



( 20 ) 


spreads over the entire domain of time t without the missing interval [T] if WT < 


1 since J^dwe 2mw ( t *') cannot average out to zero for \t — t'\ < 1 /W, as was 


explained in (10). This shows that the missing time interval [T] is closed if the 
bandlimit is imposed on the observed data, and thus even the first term in (19) has 
no missing time interval although it does not completely recover the original signal 
by itself. 

We suggest the formula (19) as an alternative to the original Donoho-Stark 
formula (16). The relations (18) and (19) show that if the unobserved time in¬ 
terval is very small, WT -C 1, the band limit of r[t) is significantly modified 
and goes far beyond the original \W\] in such a case, by recalling the relation 
ll-Pr-FVll VTW <C 1, the first term of (19), namely, a simple bandlimiting of 
the observed signal will provide a good approximation to the original signal. In 
practical applications, a detector with the time resolution of 10~ 8 sec, for example, 
cannot exclude unobserved short time intervals such as ICC 12 sec and one cannot 
recover all of those (infinitely many) short unobserved intervals by (16). The first 
term in the modified formula (19) automatically takes care of such short unobserved 
intervals by smearing the signals as in (20) for WT <C 1. This will be numerically 
illustrated later. 

It is generally assumed in classical physics that observation does not modify (or 
destroy) the signal. Consequently, it is assumed that, in principle, no limit to the 
accuracy in the time or frequency resolution of the detector. However, our analysis of 
(18) shows that the obtained signal is significantly modified by precise measurements 
or by the identification of a short unobserved time interval. We discuss this issue in 
the following. 
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To detect the missing short time interval [ T] in r(t), one needs to measure the 
time dependence of the observed r(t) with corresponding accuracy. Moreover, one 
needs to ensure that the observed data satisfies r(t) = sw(t), namely, bandlimited 
for all the time t except for the interval [T], For simplicity, we assume the vanishing 
noise n(t) = 0. Our basic assumption is to describe the given signal by the projective 
measurements (sw\Pt'\sw) = /r T ,, dt\sw(t)\ 2 and (sw\ Pw |%) = ft W n dw\sw{w)\ 2 
which are consistent with our use of L 2 norm. Starting with the observed signal r(t), 
one may divide the total time [T°] — [T] into small sub-intervals specihed by critical 
[T c ] and examine the assumed relation r(t) = sw{t) projectively in each interval 
[T c ], (r\PT c \r) = Jj T j dt\r(t)\ 2 , where the different center of each interval is implicit; 
we examine each segment of the obtained signal -Pr c |r)/||P:rJr)|| and check if this 
segment is bandlimited within W, 

(r\P Tc PwPT c \ r )/(r\P Tc \r) = 1. (21) 

Using the bound to the conditional measurement in (4) with Pt and Pw inter¬ 
changed, one then obtains a necessary condition |T C |IU > 1. This relation, in partic¬ 
ular \T C \W = 1, gives a condition to obtain the reliable and sufficient information to 
describe the classical signal by the projective analyses Pw and Pt c ■ This is precisely 
what the uncertainty relation (7) tells. In the present formulation, classical and 
quantum measurements become rather similar. 

The identification of the unobserved short interval [ T] with TW < 1 thus in¬ 
evitably disturbs the bandlimited property of the obtained data, as (18) indicates. 
Donoho-Stark mechanism and also Shannon-Nyquist sampling, which is explained 
in further detail later, allow the significant modification of the obtained signal by 
the identification of the unobserved short interval or by the active measurements 
of short intervals, but it is assumed that one can later recover the original signal 
from the observed data. A crucial difference from quantum mechanics is that we do 
not have the notion of reduction in classical physics; the conditional measurement 
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in (4) uses the modified state for the second measurement but the original state is 
implicitly assumed to be still there even after the first measurement. The obtained, 
data are modified, namely, the observed shape of the signal is different from the 
original one but the original signal is still there as is seen in |r(t)) = (1 — P-r)|s(f)) 
and s(t) is recovered by inversion; the uniqueness proof in (15) depends on the same 
bandlimited property of the original signal s(t) even after the measurement. In con¬ 
trast, reduction implies that the initial state disappears after the measurement in 
quantum mechanics. 

As for the general recovery of missing time intervals, a missing interval [T] with 
TW > 1 is fatal to Donoho-Stark mechanism (and also to Shannon-Nyquist sam¬ 
pling) since the bulk of the information may be lost or mathematically 1 — P? is not 
inverted. The recovery of such missing information is ” ill-posed” in the conventional 
sense, and this is precisely where the compressed sensing scheme works with the aid 
of a priori information such as sparsity and low-rank assumptions jfj-sj]. 

IV. SHANNON-NYQUIST SAMPLING AND DONOHO-STARK MECH¬ 
ANISM 

We have discussed a modified Donoho-Stark formula (19), in place of the original 
one (16), which incorporates both of the post-measurement smearing of the unob¬ 
served interval [ T] in r(t) by bandlimiting operation and the deterministic recovery. 
This property suggests the common basis of Shannon-Nyquist sampling, which re¬ 
stores the original signal by combining a sampling of short time intervals T < 1/W 
with suitable later bandlimiting operation using Fourier analysis, and Donoho-Stark 
mechanism, which restores the signal in a specific short interval T < 1/W with the 
help of the uncertainty principle; Fourier analysis and the uncertainty principle are 
closely related in classical physics. 
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To be more specific, it is natural to assume that one knows the values of the signal 
at both ends of the unobserved time interval, Tk and Tk+i with Tk+\ — Tk = T, in 
the analysis of Donoho and Stark since they assume that the entire signal was 
precisely measured outside the specific interval [T], See (12) with a vanishing noise 
n(t) = 0. See also Fig.l. To be exact, one needs to define the unobserved interval 
by [ T) = {t : Tk + e /2 < t < Tk+i — e/ 2 } with an infinitesimal positive e but we 
forgo the technical details. One may then divide the observed signal into equal sub¬ 
intervals with a size T and denote the end points of those intervals by {T 0 ,..., Tk- 1 } 
and { Tk+ 2 , T/v} with N a minimum integer which satisfies T N — T 0 > |T°|, where 
[T°] stands for the total time interval in which the entire signal is contained. Since 
one knows s(kT) for k — 0, ...,N and s(kT) = 0 for all other k, one can apply the 
Shannon-Nyquist reconstruction formula 


sw'(t) = ^2 s (kT)h T (t — kT) 


( 22 ) 


kez 


where W' = 1/T and the sinc-function hx{t) = sm(nt/T)/(7rt/T) which forms 
a complete orthonormal set hr(t — kT)hx{t — k'T)dt/T = 8k,k r i this formula 
describes ) which contains the frequency — 7 ^ < w < 7 /^ in the Fourier repre¬ 
sentation and converges in the sense of L 2 norm 
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Since 1/T = W' > W, this signal corresponds to oversampling (and this signal 
corresponds to the detection of the domain below the uncertainty limit from a point 
of view of the uncertainty principle), and thus one may apply bandlimiting operation 
down to W (or a lowpass filter) to recover the original signal %(f). To show this, 
we define a discretized measured signal \t)sn in Shannon-Nyquist sampling by 


|s) = / dt\t)(t\s) => | r) SN = ^2 T\kT)(kT\s), (23) 

J k€Z 

which corresponds to a sampled signal rsNit) = (t\ r )sN = J0 fceZ T(5(f — kT)(kT\s), 
and one can confirm that sw'if) in (22) is given by sw'if) = (t\Pw'\r) sn- More 
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generally, 


s w if) = ( t\P w \r) S N 

= J2 T (-t\ P w\kT)(kT\s) 


k£Z 




kez 


nW(t - kT) 


( 24 ) 


where we defined s(kT) = ( kT\s ). This sw(t) is well-defined for W < W' since 
Pw s w'P ) = {t\PwPw\ r )sN — (t\Pw\ r )sN = sw(t) by noting P w P W f = P w if 
one chooses [W] C \W'\. Namely, S\y(t) is a bandlimited version of Sw'{t ) defined 
by the Shannon-Nyquist reconstruction formula (22) and agrees with the original 
bandlimited signal. 

We have sw'ikT ) = s(kT ) in (22), but this property is not explicit for sw(t) in 
(24). To clarify this issue, we use the relation, 


{^\ r )sN — E T(w\kT)(kT\s) 

kez 

= E Te MT s(kT) = '£ S ( W ~ < 25 ) 

k£Z k£Z 

where we used Poisson summation formula at the last step with s(w) = 
dts(t)e l2 ' KWt . Thus, the Shannon-Nyquist sampling process leads to a periodiza¬ 
tion of the Fourier transform of s(t). We are considering a bandlimited s(t), namely, 
s(w ) has support in [W]. We can then avoid aliasing (i.e., the overlap of adjacent 
terms in the last expression in (25)) if we choose T < 1 jW. The set of values 
{s(/cT)} cannot be arbitrary and they are constrained by (25). For such {s(kT)}, 
we have s(w) = (w\r)sN for w G [W] since only the term with k = 0 survives for 
w G [W] in the last expression in (25). We thus have s(t) = sw(t) for sw(t) defined 
in (24). 

We have recapitulated the basic procedure of Shannon-Nyquist sampling by 
incorporating the idea of the uncertainty principle emphasized by Donolio and 
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Fig. 1: Schematic figure for the connection between Shannon-Nyquist sampling and 
Donoho-Stark mechanism. 

Stark. Since {r(kT)} = (s(fcT)} by assumption, the knowledge of the observed 
r(t) is sufficient to reproduce s\y{t), and thus the signal recovery of Donoho and 
Stark is justified by Shannon-Nyquist sampling theorem; the difference is that 
Donoho-Stark gives the precise result while Shannon-Nyquist needs a lowpass filter 
to recover the original signal. The connection between Shannon-Nyquist sampling 
and Donoh-Stark mechanism is schematically shown in Fig.l. 

A new signal recovery formula 

We now illustrate a new scheme of the information recovery from the do¬ 
main below the uncertainty limit using the idea of Shannon-Nyquist sampling by 
taking the shape of r(t) into account. We thus define a Shannon-Nyquist sampled 
signal corresponding to the measured value r(t) in Donoho-Stark mechanism, 
rDs(t) = E k ezT S N5(t - kT SN )r(kT SN ), where | r) = (1 - P Tos )\s). To treat 
a general case, we introduced two time intervals, Shannon-Nyquist T S n and 
Donoho-Stark T D $, which satisfy T D g < T S n < 1 /W. We then have the Poisson 
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summation formula 


^ T SN e i2 ™ kTsN r(kT SN ) = ^f(u; - 

k£Z k£Z 



From (25) and (26), we obtain the relation 


k£Z 


T, 


SN 


= y ^r{w — 

k&Z 



(26) 


(27) 


since s(kT SN ) = r(kT SN )- 

By restricting w £ [ W] in (27), we have 

°° k k 

S(w) = P w r(w) + y^P w [r(w- ——) + r(w + -—)] (28) 

t SN J- SN 

for W < 1/Tsn since only the term with k = 0 on the left-hand side of (27) is 
non-vanishing for w £ [W] ; note that s(w) is non-vanishing only for w £ [W]. 
The knowledge of f(w) = {w\r) = (ty|(l — Pt ds )\s) for w £ (—cxo, cxo) is thus 
sufficient to recover s(w) bandlimited in w £ [W] and thus original s(t). Note that 
Tds < Tsn < l/W. The basis for the above relation (28) is that s(kT SN ) = r(kT$N) 
for all k but the bandlimit is different for s(w) and f(w) due to the operation P t ds - 
See (18). 

The relation (28) is analogous to (19), but there exists a difference. All the 
terms on the right-hand side are expressed by Pw?(w) in Donoho-Stark formula 
(19), while the extended bandwidth of r(w) beyond 1/Tsn is crucial in (28), 
which is analogous to the original Donoho-Stark formula (16) with the extended 
bandwidth of r(t) as in (17). In retrospect, (28) is valid for r(t) of any shape with 
r[kT S N ) = s(kT SN ) and extended bandwith beyond 1/Tsn, n °t necessarily the 
form in Donoho-Stark mechanism. In all those cases the observed r(t) reproduces 
the bandlimited s(t), but at the same time the refined (below the uncertainty limit) 
time variation of r(t) is generally lost in this procedure. This aspect of smearing 
the information below the uncertainty limit is another important aspect of our 
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Fig. 2: In the upper graph, the original signal s(w) and the prediction of (28) with 
the first 5 terms for Tds = Tsn = 1/4 s are shown. In the lower graph, the Fourier 
transform of the observed signal r(w) in Donoho-Stark mechanism (with W = 2 Hz and 
Tds = Is, l/4s, l/64s) is shown. As TosW decreases, Pwr(w) approaches s(w) given in 
the upper graph. When TdsW > 1 (with Tds = Is), Pw?{w) is seriously distorted and 
can not be used to recover the original signal via (|19D (since (1 — PwPt ) is non-invertible 
in this case). 

information recovery formula (28), and it is close to our common understanding of 
the quantum mechanical uncertainty relation. 

Numerical illustration 

Finally, we show that the bandlimited first term in Donoho-Stark mechanism 


18 



















(19), where |r) = (1 — Pt ds )\s) , gives a useful approximation to s(t). This definition 
of |r) is written as 


(u>|r) 


(w\s) - T ds 



dw' 


sin ttT ds (u! — w') 
ttT ds {w - ui') 


(u/|s) 


(29) 


where we set to = 0 in the definition of Pt ds in (1)- The formula (19) corresponds to 
an iterative solution to the ’’integral equation” (29) defined for w G [W] by treating 
Tps as a small coupling constant. For small TdsW -C 1, one can show that the 
bandlimited Pw?{w) = Pw(w\r) provides a very good approximation to the original 
s(w), namely, (29) gives 


P w f(w) ~ s(w) - WT ds ( [ dw's{w')/W), (30) 

J[W] 

which is illustrated in Fig. [2]by assuming a specific example of s(w) with 1/W = 1/2; 
in t-representation, this s(w) corresponds to s(t) = 2(1 — cos27rf)/(27rt) 2 which is 
non-negative and assumes s(0) = 1, s(±l/2) = 4/7r 2 ~ 1/2 and s(±l) = 0. 

We also illustrate our proposed signal recovery formula (28) for the case Tds = 
Tsn = 1/4 < 1/W = 1/2, namely, the recovery of the signal, for which the peak 
values of the signal s(t) between s(l/8) and s(—1/8) is missing, is shown by a 
dash-dot figure in the upper graph in Fig.2 {T D s = Tsn is allowed since both are 
smaller than 1/W). The first term Pw?(w) alone almost recovers the signal, but the 
convergence of the rest of terms is rather slow, which we have confirmed by summing 
the series up to first 5 terms with k = 0,±1,±2 in (28). This slow convergence is 
partly related to the sharp cut-off induced by Pt ds ■ This use of the first term 
Pwf(w) alone is close to the customary procedure to deal with the missing time 
domain of sub-uncertainty limit in quantum mechanics using only the information 
allowed by the detector capacity. 

The analysis in this section shows that the original band-limited signal is, in prin¬ 
ciple, recovered without knowing s(t) within an interval [T] below the uncertainty 
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limit T < 1/W by a variety of ways. Donoho and Stark have given an attractive 
physical picture, namely, the uncertainty principle, for Shannon-Nyquist sampling 
and related formulas which are often discussed using the Poisson summation for¬ 


mula 


13|. 


V. RECOVERY OF MISSING STATES IN QUANTUM MECHANICS 

It is interesting to examine the possible information recovery below the uncer¬ 
tainty limit in quantum mechanics. From a point of view of the uncertainty relation, 
the momentum-coordinate uncertainty relation in the manner of Landau-Poliak [ll| 
is close to the uncertainty relation used by Donoho and Stark in information theory, 
although the notion of reduction is crucial in Landau-Pollak-type uncertainty rela¬ 
tion. We thus consider the probability amplitude ^(i,x) = exp[—27Tin this 
paper and discuss a possible recovery of an unobserved small interval [A"] in x ) 
for which allowed momentum is limited. 

We first recall the definition of Landau-Pollak-type imcertainty relation. The 
projection operators are defined by 

rpo+\P i‘x Q +\X 

P P = dp\p)(p\, P x = dx\x)(x\, (31) 

Jpo-\P Jx o-ix 

using the relations ( x\x') = S(x — x'), (p\p') = 5(p — p'),and ( x\p ) = exp[27r ipx\ 
where we adopt the convention 2nh = 1. The choice po = 0 is convenient in our 
application. As for the uncertainty principle, the upper bound to the probability of 
conditional measurement (4) is now replaced by 

(^PpPxPpW) _ \Pp(PpP x Pp)Pp\i>) 

WPpty) W PpPpW) 

< \\PpP x Pp\\ = \\P x Pp\\ 2 < PX, (32) 

and the condition for the consistent description of a state in terms of P x and Pp 
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(or compatibility of Px and Pp), (^|PpPxPp|V ) )/ (i } \Pp\i } ) — 0 implies 

XP > 1, (33) 

which is the Landau-Pollak-type uncertainty relation [ll]. We here comment on a 
specific aspect of the quantum mechanical state recovery related to reduction. The 
notion of reduction implies that we have 

IV’p) ~>*■ \M = (1 — Px)|^p)/||(l — Px)|^p)|| (34) 

after the measurement of (1 — Px) in quantum mechanics, while we have 

| tpp) ->• | i>p) = (1 - Px)\tpp) + Px\ipp) (35) 

after the measurement of (1 — Px) in classical theory, namely, the state itself is not 
modified by measurement. Thus the recovery of the original state \ipp) is natural in 
classical theory but the quantum case is conceptually more involved. 

The deterministic state recovery from the measured data of coordinate in one¬ 


dimensional quantum mechanical problem is known 
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3, 


and it is used to analyze 


the possible recovery of a small missing interval [X] in the coordinate with XP <1 
by analyzing a prepared state 


I V'm) — (1 — Px)\^p)/ 11(1 — Px)Hi 


(36) 


where the momentum is initially limited within [P] for the state | ipp), namely, 
Pp\iPp) = \ r ijjp) . Our purpose is to recover the state |Vtp) from the given for 
XP < 1. 

The analysis of probabilities shows 

{fpp. PxPpPx\^p) 


('ipp\P x \*pp) 

W’p 1(1 — Px)Pp c ( 1 — PxMp) 

(iI>p\Px\^p) 


< XP < 1, 

1 _ {^p\PxPpPxH>p) 
{' 1 Pp\Px\' 1 Pp) 

> 1 - XP > 0, 


(37) 
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and thus both Px|V ; p) and (1 — Px)\ipp) contain momenta outside the momentum- 
limit |P|. Here we defined Ppc = 1 — Pp which satisfies PpcPp = 0 and Ppc\'i/jp) = 0. 
The prepared state | i/jm), which has a gap in the coordinate dependence, thus spoils 
the momentum-limited property. It is conceptually simpler to discuss the recovery 
of \ipp) from 


PpWm) = (1 - PpP x PpMp)/m - PpP x Pp)Hi 


(38) 


which has no gap in coordinate space 


{x\P P \M x ||(l-P P P Y Pp)|^p)|| 

= <a#p> - f dp [ dye 2 ^-y\y\^p) 


= {x\ ip P ) 


J p 

XP 


ix 


dy sin 7 xP(x — y) 


(y|iM 


(39) 


lx x nP(x - y) 

where 0 < XP^^-^- < 1 for x, y e X with XP < 1. Thus the gap in (x|-0 m) 
for x £ X is smoothed and disappears in {x\Pp\ij)M) for x € X with XP < 1, 
which is regarded as a consequence of the ordinary uncertainty principle in quantum 
mechanics. The use of Pp^m) corresponds to the adoption of the modified version 
of Donoho-Stark scheme discussed in (19) and (20). 

We now sketch the basic idea and procedure of the deterministic reconstruction 
of the quantum mechanical state Pp^m), which is momentum-limited and has no 
gap in coordinate, from the measured data following the formulation of Leonhardt 

/s ~2 

and Schneider 18], which is based on the Hamiltonian H = ^ + U(x) with an 
arbitrary stationary potential. Only the case of a free Hamiltonian with U(x) = 0 is 
discussed in the present paper, for simplicity. They start with the time dependent 
density matrix 


p M (t)=e lHt Pp\i> M )(^M\Ppe 


iHt 


(40) 
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After the assumed ideal measurements of ^-dependence by the projection operator 
P x = |£)(x|, one obtains the diagonal elements of the density matrix 


pf(t) = J^|x)(x|e lHt p M (0)e lHt \x)(x\ 


Y Y \ x )( x \p) e “^'^\v\Pm{®)W)(jp'\ x )( x \ 

X p,p'£P 


(41) 


where (p\e~ lHt = {p\e~‘ l ' jl ^ t with u>(p) standing for the kinetic energy of the particle. 
The appearance of only the diagonal elements is a result of quantum mechanical 
reduction, and the important idea in their analysis [l7, 1|| is the examination of 
time dependence in (41) which supplies extra information not available by the mea¬ 
surements of spatial dependence; one can thus determine those off-diagonal elements 
specified by ca(p) — cv(p') from the diagonal elements of the density matrix in the 
coordinate representation, and one eventually recovers the state in (38), namely, 
(x\Pp\iJ)m) — (X(l — PpPxPp)\'fp)/\\{^- ~ P P P x Pp)\^p)\ \ from the measured data. 
Note that we need the full density matrix including off-diagonal elements to deter¬ 
mine each state contained in the density matrix. Further details are found in y 
One may thus recover the original state \f>p) by an inversion operation applied 
to Pp\f>M) by noting that the non-negative hermitian operator P P P x Pp satisfies 
\\PpPxPp\\ <XP< 1 in (32), and 

1 


IXp) = 


1 — PpPxPp 


-Pp IXm)||(i — PpP x Pp)\'fp}\\ 


= [1 + PpPxPp + (PpP X Pp) 2 + ...]Pp\M\\(l- PpP X PpMp)\1 (42) 


which is analogous to the procedure of Donoho and Stark. The factor ||(1 — 
PpP x Pp)\ipp)\\ may be treated as a normalization constant to be fixed after solv¬ 
ing for | ipp). Alternatively, one may solve the equation (39) in x G X, which is 
regarded as a well-defined integral equation, for a small coupling XP iteratively 
for a given (x\Pp\ifM) and determine (x\ifp) for x 6 X, which is the part of the 
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state to be recovered. Originally, eq.(39) was defined to study the coordinate depen¬ 
dence of (x\Pp\'tpM), but now regarded as a functional relation between (x| ipp) and 
(x\Pp\i/)m) ■ The analysis we performed so far is, given the state (x\Pp\i/)m), l low to 
measure it and how to infer the state (x| ipp). 

An alternative formulation may be to measure a given momentum-limited state 
| ipp) but missed the measurement of its tiny part Px\^p) and thus the recovered 


state in the analysis of Ref. 


18] corresponds to (1 — Px)\^p)- In this case, it 


is natural to assume that one knows (x|(l — Px)\i>p)- One may then apply the 
post measurement momentum-limiting operation to obtain (x\Pp(l — Px)\' 1 Pp) — 
(x|(l — P P P x Pp)\ipp), which closes the gap Px\^p) in the coordinate dependence, 
and apply the inversion procedure discussed above to recover (x\ijjp). 

ft remains to be seen if the state recovery procedures we discussed are useful in 
the practical settings of quantum mechanical problems. The recovery of the lost 
information in the domain XP < 1 means that the loss of information in such a 
small domain is not fatal, which is in accord with our common understanding of the 
uncertainty principle, although its precise recovery is something we are not used to 
in quantum mechanics. 

As another interesting quantum mechanical problem, one may analyze the 
time-energy uncertainty relation which is less precisely defined compared to the 
momentum-coordinate uncertainty relation 19|, [20] and not strictly constrained 
by the notion of reduction ; the reduction of the state by the measurement of 
energy is well-defined but the reduction of the state due to the measurement of 
time is not defined in quantum mechanics. It may thus be interesting to exam¬ 
ine the possible information recovery from the time interval below the uncertainty 
limit as in the classical Donoho-Stark mechanism by considering a state such as 

t,x ) = Iw dwe lwt, ip(w,x) which is not the eigenstate of energy and thus not sta¬ 
tionary. Although the L 2 norm for the time dependence is not usually adopted in 
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quantum mechanics and thus differs from the case of Donoho-Stark analysis, one 
may define the relation analogous to TW > 1 in (7) as a compatibility condition of 
energy and time measurements in Fourier analysis. 


VI. DISCUSSION AND CONCLUSION 

We have analyzed the physical picture behind the recovery of signals from a do¬ 
main below the uncertainty limit in classical information theory. We have shown 
that the Shannon-Nyquist sampling theorem, which is fundamental in signal pro¬ 
cessing, utilizes essentially the same mechanism as the scheme of Donoho-Stark. 
The uncertainty principle provides a criterion of Shannon-Nyquist sampling and the 
specific Donoho-Stark scheme is not regarded as compressed sensing. A new signal 
recovery formula (28), which is analogous to Donoho-Stark formula but based on 
the idea of Shannon-Nyquist sampling, has been given; it illustrates the smearing 
as well as recovery of information below the uncertainty limit. 

We have also discussed the recovery of states from the domain below the uncer¬ 
tainty limit of coordinate and momentum in quantum mechanics and shown that in 
principle the state recovery, if suitably formulated, works by assuming ideal mea¬ 
surement procedures. Practical aspects of this state recovery remain to be clarified. 

One of the important implications of the present analysis is that the uncertainty 
principle provides a universal sampling criterion covering the classical Shannon- 
Nyquist sampling theorem and the quantum mechanical measurement, since the 
general measurement limit in quantum mechanics is set by uncertainty relations. 

We have concentrated on the deterministic information recovery in the present 
paper, but as a related problem which utilizes the compressed sensing, we mention 
a recent interesting experiment in which weak measurement and compressed sensing 
were used to measure complementary observables simultaneously. The momentum 
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distribution is directly imaged, while the position distribution is recovered using 
(classical) compressive sensing in such a manner that the uncertainty principle in 
quantum mechanics is preserved 21]. 

As for the conditional measurements in the phase_space with PX < 1, they have 
also been discussed from a different point of view 22] to account for an apparent 
violation of uncertainty relations in some specific measurement procedures 23]. 
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